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Abstract 

We study the distribution of attraction basins as a function of energy in simple 
glasses. We find that it is always broad. Furthermore we identify two types of 
glasses, both with an exponentially large number of metastable states. In one 
type the largest attraction basin is exponentially small, whereas in the other it 
is polynomially small in the system size N. If there exists a tuning parameter 
that connects one regime with another, then these two phases are separated 
by a critical point. We discuss implications for optimization problems. 
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I. INTRODUCTION 



A complex system is one whose number of metastable configurations, N^, scales expo- 
nentially with the number of its elements, N. Naively one expects that an exponential 
number of searches is required to find the optimal state. In general the identification of the 
ground-state in a complex system can be mapped onto a hard combinatorial optimization 
problem.0 However there exist examples in nature, e.g. proteins, of complex systems that 
find their ground-states on time-scales significantly faster than r ~ A^^. A possible explana- 
tion for this phenomenon is that the associated total phase volume is not equally divided 
among the metastable states. More specifically, if a significant fraction of the total phase 
volume belongs to the attraction basin of the optimal state, then a fast process leading to 
this "greedy" configuration becomes feasible to implement. A less stringent possibility is 
that the optimal state can be located relatively quickly if it is connected by a continuous 
path in the space of parameters to a state with a large basin of attraction. This is the under- 
lying approach in simulated annealing, an optimization algorithm that is very effective for 
problems where the ground-state evolves continuously from the paramagnetic configuration 
as a function of decreasing temperature.il However simulated annealing cannot be applied 
to systems where all the metastable states appear at the same temperature.Bi In this case 
an open question is whether one can identify a parameter that connects the state continu- 
ously to one with a large basin of attraction. We have addressed this issue in a family of 
simple glasses characterized by a parameter x. In particular we find that this parameter can 
be increased continuously such that there exists a small subset of metastable states which 
attract the system with significant probability V such that In ^ ^ 1 in contrast to the 
generic situation In ^ ~ 1 in complex systems. 

Here we study the basins of attraction in a family of p-spin spherical models! character- 
ized by the Hamiltonian 
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where the constraint J2iLi ^'i — ^ satisified by the spins that are represented by real 
variables Sj. Jj^jj and Ji^i^i^ are two- and three-spin infinite-range couplings respectively; 
furthermore they are completely random of arbitrary sign. In this family of glasses, we find 
that the configurational entropy, Sc = InA^^, remains extensive {Sc oc A^) for < x < 1 
whereas Sc = for precisely x = 1. This limit corresponds to the p = 2 disordered spherical 
model which has one stable solution^ and therefore an associated basin of attraction that 
is large. The other extreme parameter limit of (|1|), x = 0, corresponds to the three-spin 
spherical model with an extensive number of metastable states0'0 whose attraction volumes 
are each an exponentially small fraction of the full phase space.lii As an aside, we note that 
here we will use the normalizations 

where the angular brackets refer to an average over disorder; these expressions, (|^), are 
slightly different than those commonly found in the literature but are convenient for this 
family of mixed models. 

The p-spin random spherical models {p > 2) are believed to be the simplest models that 
possess the essential properties of a generic complex system.0 Aside from having an exten- 
sive complexity {Sc oc A^), they also exhibit history-dependance and aging characteristic of 
experimental glasses.lli The simplicity of these models arises from the long-range nature of 
the interactions, a feature that makes them accessible to direct analytic treatment; second, 
all metastable states appear at the same temperature and are orthogonal in the thermo- 
dynamic limitili which simplifies the dynamical equations for Ns ^ 00 ■ Naturally the 
evolution of a particular system with specific couplings must be studied numerically. How- 
ever the physical properties of the system averaged over all possible realizations of couplings 
can be studied analytically by a set of integral-differential equations.S'El The latter describe 
the properties of typical metastable states where stochastic processes will take the averaged 
system. Here we show that the solution of these equations implies that for x = {p = 3 



spherical model) the distribution of attraction basins as a function of energy is broad, though 
the attraction volume associated with the ground-state is still an exponentially small part 
of the full phase space. This regime persists up to finite Xc ~ |. However we find that as 
we continuously tune x to x > Xc the complexity remains extensive {Sc oc A^) for Xc < x < 1 
but the ground-state acquires a large basin of attraction that far exceeds the average and is 
a significant fraction of the total phase volume. 

We extract the distribution of attraction basins from the dynamical equations of the 
mixed model ([l|) as a function of x. More specifically, we relate the size of an attraction basin 
associated with a physical state to the critical overlap, q*, between this state and a partially 
randomized one that still evolves back to it. In particular, the limit q* ^ corresponds to 
a basin of attraction that occupies a significant portion of the available phase volume. The 
critical overlap q* is found from the solutions of the dynamical equations of ([l|). 

The outline of this paper is as follows. In Section II we discuss the general approach taken 
here, in particular the determination of the critical overlap as a function of energy, q*{E). In 
Section III we apply this approach to the pure p = 3 random spherical model and study the 
attraction basins as a function of energy. Next we turn to the mixed model (0) and determine 
the distribution of attraction basins for different values of x. We find a parameter regime, 
1 > X > Xci where the mixed model has a typical state with large trapping probability 
(-^ In ^ <^ 1); furthermore in this regime the mixed model has marginally stable states. In 
Section IV we summarize our results in a discussion, noting that this conclusion is based on 
a study of dynamical equations that appear in a broad class of glassy models;^! in particular 
they also describe glassy systems without quenched disorder .i^h^l These equations have also 
been proposed on phenomenological grounds for the description of freezing in structural 
glasses; they are the so-called mode-coupling equations.0 Thus we expect that our result is 
more general that the specific mixed model defined above. 
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II. THE APPROACH 



The key step in our approach is to extract the probabihty, V, with which the typical state 
attracts the system from the dynamical equations of the jo-spin model. This probability, V, 
is equal to the ratio of the attraction basin of the physical state, Wb, and the full volume 
of phase space, WpH, so that V = ^f^- We take the typical state as a reference point and 
parametrize arbitrary points in phase space by their respective angles to this configuration. 
In this framework 

WpH = M""-^ r de sin^-2 e (4) 

Jo 

where M^~'^ is the volume of the {n — 2)-th dimensional unit sphere. Similarly the volume 
of the attraction basin of the reference state is 

Wb = M''-^ r de P{e) sin^-2 Q (5) 

JO 

where P{0) is the probability that the state at angle 9 belongs to the basin of attraction 
associated with the reference configuration. 

We note that for ^ 1 the main contribution to Wpu in ® arises from sin 6* = 1, 
whereas that of Wb comes from the largest possible sin^ such that P{0) is finite. Therefore 
the behavior of P{9) for ^ ~ ^ is crucial for this discussion. It is therefore convenient to 
rewrite the expressions for Wpu and Wb using the parametrization q = cos 6 where q is 
the overlap between the typical state and that at angle 6. In this notation, assuming that 
> 1, we find that 

WpH=^f''-' rdqe-^"" (6) 
Jo 

and 

Wb = U""-^ / dq P{q)e--'i (7) 
Jo 

where we note that the main contribution to Wph, displayed in (|^), arises from small q ~ 
There are two possible scenarios: 
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(i) P(q) = for q < q* (where q* > -^). 

We note that this threshhold coincides with the previous definition of g*, the critical overlap 
beyond which a partially randomized state evolves away from the reference state. In this 
case 

V^^o. e-T(^*)^ (8) 

WpH 

and 

1 1 

(9) 

(a) P{q) = f{q) so that there is no threshhold (i.e. q* 0). 

Then the probability that the reference state attracts the system is not exponentially small 
and 

— In-<1. (10) 

Therefore the size of the attraction basin associated with the typical state is determined 
by the value of the critical overlap q* = cos 9*. We expect q* to have a distribution of 
finite width; in this case states with the smallest value of q* will have exponentially larger 
attraction basins than the others. Furthermore if g* ^ then these states will have basins 
of attraction that are a significant fraction of the full phase volume. 

We now discuss how to extract P{q) and q* from the dynamical equations of the fam- 
ily of p-spin spherical models. These equations determine the time-evolution of averaged 
correlation (Dtti — {s{t)s{t'))) and response (Gu' = (^^)) functions for arbitrary sample 
history. In order to find P{q), we consider the evolution of a state where at time to a fraction 
1 — g of the total spins is randomized so that at time tQ + e the system is in a random state 
corresponding to overlap q with the state at tg. In terms of Dtf and Gtf this randomization 
translates into a boundary condition 

Ao+e,t' = (1 - g) Ao*' (11) 

Gto+e,t' = (1 - q)Gtot' (12) 



where to > t'. The solution of the dynamical equations yields Q{q) = limt^oo Duo^tiQ), the 
average overlap between a typical state and that which has evolved from it in the manner 
described above. This quantity can be interpreted in a simple way if all metastable states 
are orthogonal; in this case Q{q) is equal to P{q), the probability that the system evolves 
back to its original configuration after a fraction {1 — q) spins has been randomized. This is 
indeed the situation for the family of spherical spin models that we study here where there 
is only one-step replica symmetry breaking as in the pure p = 3 spherical modelP details of 
the replica solution for the mixed models are presented in Appendix I. 

We note that Q{q) depends implicitly on the properties of the typical state at time to- 
The dynamical equations with random initial conditions yield Q{q) averaged over all typical 
states. This average is dominated by the states for which the combined basin of attraction is 
maximal; for instance if states are characterized by their energy, this quantity N{E)Wb{E) 
is usually largest for states with the highest energy which are still stable, namely states 
that are marginally stable. In order to probe states with different energies, one needs to 
introduce different initial conditions via source terms in the dynamical equations. The 
solution of these modified equations yields Q{q, E), the overlap averaged over typical states 
of fixed energy E. 

The dynamical equations for the family of spherical models with Hamiltonian (0) have 
the form 

/3'^ f (3^ f 

{at, + <9tjAit2 - 2^4,42 - Y y Ut,tGtt2dt - y y T^t^tDu^dt = <Sd (13) 

and 

{at, + dt,)Gt,t, - Y / ^HtDtt.dt = 5{h - h) (14) 

where /5 is the inverse temperature, S and 11 are self-energy terms, at is determined implicitly 
by the condition Dtt = Gtt = 1 and iS/j is a source term that fixes the initial energy. For 
this mixed model with ^ 1, we have 

-Lt.t, = 2(1 - x){GD)t,t, + xGt.t, (15) 
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Ilt,t, = {l-x)Dl^^+xDt,t, (16) 

and 

Sd = ^ (a' oA.o(l -x) + xA.oA.o) (17) 

where Eq is the energy of the initial configuration at t = 0. In the two self-energies, (|T3p and 
(|I^), we recover known results for the p = 2 and p = 3 spherical models for x = 1 and x = 
respectively.0'lli The source term, (0), is derived by introducing a term 5{H{t = 0) — Eq) 
into the functional integral for the stochastic dynamics, representing it as an additional 
integral over a Lagrangian multiplier where the latter is determined by the initial energy 
Eq. In order to obtain P{x,q,E), we solve this system of equations varying these three 
parameters. 



III. RESULTS 

In Figure 1 we display the spin-spin correlation function, Du', of the x = {p = 3) 
spherical model after a fast quench (i.e. with random initial conditions) as a reference start- 
ing point for our subsequent discussion. Apart from a narrow range t' ^ t, this correlation 
function obeys a scalingS form Dtf ~ (f')'^- 

In Fig. 2 we show the correlation function for the solution when the system was partially 



randomized at to = o described in (|TT]) and (|T3)- As an aside, we note that here and in 



what follows we present results for = 2; we have checked that they are weakly dependent 
on this ratio. As expected, increased randomization leads to a decreasing overlap between 
the state at to and at t = 2tQ. We also note that Dt-^t2 shows power-law aging behavior, 
Ait2 ~ (it)' ■'^'^^ ^i>^2 < to; for ti,t2 > to the relaxation starts again and Aii2 = d. (p^r^)- 
These curves were determined numerically for finite to] as to oo we expect that the 
limiting value of these overlaps tends either to Qo or to zero slowly. For example, a factor of 
two increase in the overall time changes Du' a little bit as displayed in Fig. 2 by the dashed 
and full curves. Therefore a systematic finite-time analysis is necessary to determine the 

8 



value of q*. The dashed and full curves presented in Fig. 2 indicate that q* lies between 
qi and q2 because the plot for qi decreases with increasing whereas the opposite is true 
for q2. We note that the slow decrease in Q{qi) with overall time can be understood as a 
finite-time effect; more specifically Q{qi) follows the same time evoluation as Dto for the 
reference dyanmics without randomization (see Fig. 1) such that 

In Dto+e,to In A,o 1 



In t In t 4 ■ 

dQ jg) 



(18) 



In order to obtain q* more precisely, we consider the derivative ^^^^ . We determine q* from 
the equation = where we check that the value of q* obtained in this fashion is not 
dependent on the overall measuring time. We note that the result, namely that q*{E = 0) 
is finite for x = {p = 3 spherical model), is consistent with the conclusions of an earlier 
study of this modehlli 

Until now, we have considered solutions to the dynamical equations, (0) and (^4|), 
with random initial conditions; as we have discussed earlier these probe high energy states 
that are marginally stable, a feature that is responsible for their power-law evolution. We 
now turn to lower energy states as shown in Fig. 3. In order to access them we must 
fix our initial energy to be Eq < Eq- In Fig. 2 we display typical spin-spin correlation 
functions in this energy regime. The red curve indicates clearly that for sufficiently large q 
the system recovers its state at to- For smaller q the state ai + e evolves away from its 
reference state (see Fig. 4) in a manner similar to that of Du' with completely random initial 
conditions (see fig. 1). Despite this qualitatively different behavior for large and small q, 
q* must be determined by the same finite-time scaling that was discussed earlier. Such an 
analysis indicates that q*{x = 0,E) remains finite for all energies. Therefore the basins of 
attraction in the p = 3 spherical model increase with decreasing energy, but always remain 
exponentially small compared with the full phase volume. El 

In weakly frustrated systems where the number of metastable states is subexponential, 
some basins of attraction must be large. An example of such a system is the p = 2 spher- 
ical model.0 An interesting question is whether it is possible to have some large basins of 
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attraction but an exponential total number of states. We expect an exponential number of 
states in a mixed p = 2 and p = 3 spherical model, and therefore study a family of such 
systems to see whether they ever acquire typical states with large basins of attraction. 

We have checked that there is one-step replica-symmetry breaking for < x < 1, and 
details are presented in Appendix I. As a result, we know that all metastable states appear 
at T = Tc and that there is no further subdivision of states at lower temperatures. We can 
therefore perform an enumeration of these configurations at T = 0. We have verified by 
direct computation that the logarithm of the number of states for this mixed model is 

which is zero only at x = 1 {p = 2) where x is a mixing parameter as defined in the 
Hamiltonian (|l]). Details of the calculation that yields (|19j) are given in Appendix II. 

We repeated the numerical analysis outlined above for values of x such that < x < 1. 
Our results for q* are summarized in Fig. 5. As shown there, for x = 0.3 all basins of 
attraction remain exponentially smaller than the full phase volume. However for x = 0.6, 
the critical overlap q*{E) is zero at Eq indicating that states of energy Eq have basins of 
attraction that occupy a significant fraction of the full phase volume. 

Now we discuss possible weak points in this argument. We have assumed the exact 
orthogonality of the metastable states which is only true to order This might lead to 
q* ~ instead of g* = for the states with large attraction basins. This correction would 
result in P ~ A^~" with a of order unity. Another weak point in the argument might be 
the effect of finite-size corrections to the equations (11)-(17) which were originally derived 
in the thermodynamic limit. For the p = 3 spherical model we have derived the subleading 
terms in which modify the expressions for the self-energies S and 11, included them in 



equations (13) and (14), and have checked that their effects are perturbative. Furthermore, 
because the self-energy scales as D^^ higher-order terms in e.g. terms of order O(-j^), 
cannot change the solution of equations (PIBI) and (O) for D > and thus cannot lead to 
q* > Therefore in the mixed p-spin models we expect that higher order terms in jj: can 

10 



only lead to power-law corrections in V, and thus do not qualitatively affect our results for 
^In^ 

IV. DISCUSSION 

We have studied the attraction volume of a typical state of energy E in a family of 
disordered spherical spin models which interpolate between p = 3 (extensive configurational 
entropy) and p = 2 (one stable solution) as a function of a tuning parameter x. For < x < 1 
the total number of metastable states is exponential in A^. We find that for small x (i.e. close 
to the p = 3 model) the largest attraction basin is an exponentially small fraction of the full 
phase volume; this is true despite the fact that it is a strongly varying function of energy. 
We also find that for x > ~ 0.5 the largest attraction basin constitutes a significant 
part of the full phase volume, although the total number of states remains exponential. 
We did not find any thermodynamic signatures at x = Xc, and thus believe that only the 
dynamical behavior of these glasses changes qualitatively at this critical point. We note 
that the singularity is approached as a function of decreasing x with increasing randomness 
in the models. Furthermore the critical point described here separating polynomially and 
exponentially small reduced attraction volumes {V = ^^ ) as a function of x bears striking 
ressemblance to that studied recently in K-satisfiability problems-^! 

An important open question is the physical origin of the state with large attraction 
volume that appears for 1 > x > Xc- At x = 1 its presence is not surprising because there 
exists only one stable solution. It seems plausible that this state evolves continuously with 
decreasing x and retains its large attraction volume until x = Xc, this has been confirmed by 
complementary numerical studies. We denote this state by A{x). Metastable states appear 
at X < 1; at values of x just slightly below 1 they have energies in a small interval {E*, Em) 
separated from i?_4, the energy of the state A, by a gap (cf. Figure 6) and exponentially small 
attraction basins. Thus, A is both the optimal state and the state with the largest attraction 
basin for x close to 1. In the limit x — 0, ^4 loses both of these special features, namely it is 
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no longer the ground-state and also has an exponential small attraction basin. Generically 
there are three possible ways that this can happen, shown schematically in Figure 6. Here we 
sketch the reduced attraction volume, V = ^f^i as a function of x; for x < x^V becomes 
exponentially small. We also show schematically the relative energy, Ejs, — E* , between that 
of state A{x) and the lower edge of the "continuous" spectrum. In scenario 1 (see Figure 
6), A retains its optimal status in the vicinity of Xc even though it loses its large attraction 
volume. By contrast in case 3 (cf. Fig. 6), A loses first its optimal character and then its 
large basin. Finally in scenario 2 (cf. Fig. 6) both special features are lost simultaneously; 
our complementary numerical studies of the mixed p = 2 and p = 3 disordered spherical 
models suggest that they are in this class. Solutions of optimization problems that fall into 
category 1 (and perhaps category 2) may be accelerated by noting that the ground-state 
for X < Xc is continuously connected to Ax>xc by tuning the parameter x. In principle one 
would start by locating A{x) for x > Xc, a. relatively easy problem due to its large attraction 
volume, and then reduce x continuously to its value of interest {x < Xc). This procedure is 
reminiscent of simulated annealing where temperature plays the analogous role of the tuning 
parameter x. It may therefore provide an alternative optimization algorithm for a certain 
class of NP problems. 

We thank A. Barrat, A. Cavagna, S. Franz, I. Giardina, M. Mezard, R. Zecchina and 
particularly A. Lopatin for useful discussions. 

V. APPENDIX I 

Here we sketch the derivation of the thermodynamic properties of the mixed p = 2 
and p = 3 spherical spin models in the replica approach. Our main goal is to show that 
low-temperature state is described by the one-step replica symmetry breaking solution at 
all X such that < x < 1. We follow the standard replica approach developed for p-spin 
spherical modelsi with slight modifications implied by the mixed case that we consider here. 
We introduce order parameter Qajs = (Si^aSi^js) and integrate out the spin degrees of 
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freedom. We get the free energy as a function of Qap 

F{Qa,) = -^{^-^T.Qlp + ^T.Ql,}-^T^^^Q (20) 

which should be minimized over all Qaj3 that satisfy the constraint Qaa = 1- Varying this 
free energy with respect to Qai3 we get an expression for the order parameter 

^ {(1 - x) Qlp + xQ^p} + ^Q-\(, = (21) 

where Q^^ denotes matrix inversion. 

In order to solve equation we multiply it by the Q matrix, look for the solution in 
the form Q = 1 + q and use the Parisi ansatz for the matrix q. Next we exploit the structure 
of the matrices involved in order to solve the resulting equations in the limit n — > 0, More 
specifically we note that two matrices, A and B, that have the block structure of the Parisi 
ansatz and are described by the functions A{z) and B{z) in the limit n — >• obey the 
"multiplication rule" 

fl rl 



j'^ AyBydy + A, j ^ Bydy + B,J^ Aydy + xA,B, (22) 



Using this rule for matrices Aa/3 = (1 — x) g^^ + xqa/3 (i.e. A^ = {1 — x) q"^ + xq^) and 
Ba(3 = qai3, we see that for all 2; 7^ 1, i.e. for all non-diagonal elements of the corresponding 
matrix, the (p2D becomes —{AB)^ = (1 —x)q'^ + (l + x)^^. Differentiating this equation once 
with respect to z, we obtain 

A[ C Bydy + Aydy + z{A^B, + A,B',) = [2(1 - x)q, + (1 + x)] 4. (23) 

J z J z 

All terms in the preceeding equation are proportional to c( . Assuming that 7^ (i.e. 
that solution is smooth), we divide it by g' and differentiate it twice with respect to z. We 
obtain the equation 

i- = \ (24) 

4(l-x)g + 2x ^z{\-x) ^ ' 

that clearly does not allow a solution with positive q and q' . Thus, we have proved that 
smooth solutions with g' 7^ corresponding to continuous replica-symmetry breaking are 
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impossible. Assuming now a one-step replica breaking corresponding to a step- like function 

Qz a.t z = Zq, we get the free energy 

F(q) = +1- (i^g3 + ^ 2K ^ 1 ^ -Q _ T _ , . 

vy; ^4t\ 3 ^ 2^ J 2zo 1 - {1 - Zo)q 2 ^ ^ ^ 

Numerical inspection of this function indicates that at low temperatures it always has a 
maximum for some < Zq < 1 and < g < 1 corresponding to a non-trivial one-step replica 
breaking solution. 



VI. APPENDIX II 

We now present a skeletal derivation the number of stable solutions, Af{x, e), associated 
with the system of equations 

Asj = 2 ^ JijSj + 3 ^ JijkSjSk (26) 

j jk 

Ne = Y^ JijSiSj + JijkSiSjSk- (27) 

ij ijk 

and the sum on the spin variables J2iLi ^1 = ^- Here e is the physical energy per spin of 
the metastable states, and can be conveniently represented as a sum 

e = ^(A + e) (28) 

where Ne = Y^ij JijSiSj is the energy contribution from the two-spin model. 

In order to compute the number of metastable solutions,!^ we use the expression 

XiX, e,x) = J n, ds, 5{Y: - N) 5 (^f^) det (|^) S{m - J,,s,s,) (29) 

where we perform the calculation at T = 0, exploiting the absence of subdivision of states 
for T < Tc- The determinant in (|29| ) can be calculated by noting that Aij = is 
a random symmetric matrix with a semicircular density of eigenvalues distributed in the 
interval between X — fio and A + /Uq. We will see later that A/'(A, e) is dominated by A = //q; 
in this case 
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V = ln(det A,) = f (l + In (30) 

where the x-dependence of the preceeding expression arises from disorder-averages over the 
couphngs, {Jfj) and {Jjjk)- Implementing an integral representation of the 5-function, we 
write 

M{\ e,x)=J n, ds, n. ^ ^ e^^+^ 5iY: - N) (31) 

i 

where the effective Lagrangian is 

C = Nfie + A ^ (f)iSi ~ jJ^Yl SiJijSj - 2 ^ JijSj(j)i - 3 ^ JijkSjSk(j)i. (32) 

i ij ij ijk 

We average the couplings over disorder to obtain 

£ = Nf^e + AE 0.^. + ^{^ + jrT.<^l + ^^(E + ^ E <P^^] ■ (33) 

i (. i i i ) 

We note that the change of variables (fi — ^ {(f)\\,(f)±) where (f)\\ = so that the effective 
Lagrangian is no longer a function of Sj. We can perform the integral over the spin variables 



in (|3l|) with the result 



AA(A,e,x) = /^^n^-^e^^+^ (34) 



where 

iNxjJ? r— 1 



C = N^e + + XVN(P\\ + - {(0^ + (Pi) + (2 - x)(Pl + 2fixv^(P\\} (35) 

and 

N 

V = —{2 + \n7r{2-x)}. (36) 

Integrating over the remaining variables //, (f)\\ and 0^ in O) and using the relation e = 
3e — A, we obtain 

, X X 2A2 12(e(a;-3) + A)2 1 

In AT A, e, a; = IT 2 + In 2 - x) - ^ ^ ; f . 37 

2 1 3 — X (3 — x)x[l — X) ) 
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In order to determine the total number of metastable states, we maximize A^(A,x,e) with 
respect to A subject to the constraint that A > /Uq where 

/io = 2^N{Al) = p{2 - x) (38) 

to ensure that all eigenvalues of Aij are positive so that we are only counting stable states. 
We have checked that for < x < 1 the main contribution to A/'(A, x, e) comes form A = /io- 
This implies that at any energy for < x < 1 the majority of the states are marginally 
stable. In order to obtain the total number of states, we maximize e, A = /Uq) with 



respect to energy which yields the result (p!9|). 
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FIGURES 
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Figure 1. Spin-spin correlation function after a fast quench at T = ^Tc for the p = 3 spherical model. 
Note the fast relaxation at very short t — t' ^1. 
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Figure 2. The spin-spin orrelation function for the p — 3 spherical model after a fast quench to T = ^Tc 
followed by a randomization to to = with different fractions, (1 — g), of the total number of spin affected. 
Dashed lines refer to the results for the total time t = 10 rescaled to those for t — 20. This data indicates 
that 0.25 < q* < 0.30 since an increase in the total time t leads to evolution in different directions of 
Q{q) = linit^oo DttQ-e{q)- 
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Figure 3. The energy-dependence of the dynamical solutions for the p = 3 spherical model with 
different initial energies. Note that for all initial energies E{0) > —0.4 the energy approaches its asymptotic 
value (£'(oo) — —0.61, indicated by the dashed line) with power-law decay; by contrast for Eq < —0.4 the 
energy behavior is exponential and E{oo) depends on E{0). 
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Figure 4. The spin-spin correlation function for the p — 3 model with E{0) — —0.6 (corresponding 
to exponential relaxation) with T = ^Tc with randomization at to — ^t. Note that for q — 0.25 the 
randomization is followed by very fast relaxation back to the initial state. By contrast, a slightly larger 
randomization q = 0.20 (corresponding to the randomization of {1 — q) = 0.80 of the total spins) leads to a 
completely different states similar to that found after a fast quench. 
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Figure 5. The critical overlap, q* , as a function of initial energy, E — -E(O), for x — 0.33 (x < Xc) and 
X — 0.60 [x > Xc)- We note that in the latter case q*{E) crosses the x-axis, indicating the appearance of a 
state with a large attraction volume. 





